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Fifty-four  broad  band  models  for  computation  of  global  and  diffuse  irradiance  on  horizontal  surface 
are  shortly  presented  and  tested.  The  input  data  for  these  models  consist  of  surface  meteorological  data, 
atmospheric  column  integrated  data  and  data  derived  from  satellite  measurements.  The  testing  procedure 
is  performed  for  two  meteorological  stations  in  Romania  (South-Eastern  Europe).  The  testing  procedure 
consists  of  forty-two  stages  intended  to  provide  information  about  the  sensitivity  of  the  models  to  various 
sets  of  input  data.  There  is  no  model  to  be  ranked  “the  best”  for  all  sets  of  input  data.  Very  simple  models 
as  well  as  more  complex  models  may  belong  to  the  category  of  “good  models”.  The  best  models  for  solar 
global  radiation  computation  are,  on  equal-footing,  ESRA3,  Ineichen,  METSTAT  and  REST2  (version  81). 
The  second  best  models  are,  on  equal-footing,  Bird,  CEM  and  Paulescu  &  Schlett.  The  best  models  for  solar 
diffuse  radiation  computation  are,  on  equal-footing,  ASHRAE2005  and  King.  The  second  best  model  is 
MAC  model.  The  best  models  for  computation  of  both  global  and  diffuse  radiation  are,  on  equal-footing, 
ASHRAE  1972,  Biga,  Ineichen  and  REST2  (version  81 ).  The  second  best  is  Paulescu  &  Schlett  model. 
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1.  Introduction 

The  appropriate  design  of  many  solar  energy  devices  requires  a 
detailed  knowledge  of  solar  global  and  diffuse  radiation  availability. 
Although  there  are  several  world  maps  of  solar  radiation,  they  are 
not  detailed  enough  to  be  used  for  the  determination  of  available 
solar  energy  on  small  areas.  These  circumstances  have  prompted 
the  development  of  calculation  procedures  to  provide  radiation 
estimates  for  areas  where  measurements  are  not  carried  out  and  for 
situations  when  gaps  in  the  measurement  records  occurred.  Only  a 
minority  of  these  procedures  has  been  validated  by  their  authors, 
and  usually  under  specific  geographical  or  climatic  circumstances 
only.  To  increase  the  confidence  in  modeled  data  accuracy  there  is 
a  need  for  validation  by  independent  groups  and  at  a  variety  of  test 
sites  in  many  different  climatic  areas.  Existing  validation  reports  of 
the  literature  refer  usually  to  a  small  number  of  models  being  inter- 
compared  under  specific  climatic  environments  [1-10].  The  correct 
validation  and  comparison  of  radiative  models  raise  specific  issues. 
For  instance,  different  statistics  may  be  used  to  evaluate  the  bias 
and  random  differences  between  the  computed  and  measured  data. 
Moreover,  various  ranking  procedures  can  be  used  to  compare  the 
performance  of  models,  yielding  different  results  (for  more  detailed 
discussions,  see  [9]). 

One  problem  occurring  during  models  utilization  is  the  large 
variety  of  input  data  that  various  users  has  at  their  disposal.  It  is 
quite  usual  that  the  user  has  access  to  databases  which  do  not  cover 
all  the  necessary  input  parameters  of  a  specific  model  known  to 
have  good  performance.  In  this  case  the  user  has  to  choose  another 
model  which  fits  the  available  input  databases  or,  alternately,  to 
prepare  ad  hoc  input  parameters  for  that  specific  model.  This  last 
solution  sometimes  involves  data  interpolation  (or  even  extrap¬ 
olation)  and  lower  overall  performance  is  then  expected  due  to 
unavoidable  propagation  of  errors. 

The  present  investigation  considers  54  clear-sky  global  and  dif¬ 
fuse  solar  radiation  models,  i.e.  a  much  larger  sample  of  what  the 
literature  offers  than  in  any  previous  study.  Most  of  these  models 
have  been  previously  tested,  under  a  few  geographical  conditions, 
during  different  time  intervals  and  by  using  various  testing  proce¬ 
dures.  How  they  compare  in  practice  under  specific  and  identical 
conditions  is  still  not  known. 

Reference  radiometric  measurements  (used  as  “ground  truth”) 
are  provided  here  by  two  meteorological  and  radiometric  stations 
in  South-Eastern  Europe  (Romania).  These  stations  have  provided 
good-quality  routine  data  over  many  years.  These  are  not  high- 
end  research-class  stations,  however,  which  means  that  the  present 
study  can  be  considered  representative  of  what  can  be  obtained  at 
hundreds  of  similar  stations  over  the  world,  rather  than  at  a  few 
specialized  sites,  like  in  some  previous  studies  (e.g.  [9,10]).  These 


studies  considered  the  ideal  case  when  all  the  investigated  models’ 
inputs  were  measured  locally  at  high  frequency  with  high-quality 
instruments,  so  as  to  obtain  the  intrinsic  performance  of  these 
models  by  avoiding  propagation  of  errors.  In  contrast,  the  present 
investigation  is  much  more  pragmatic,  since  it  uses  “normal”  radi¬ 
ation  measurements  and  interpolated/extrapolated  input  data  in 
both  space  and  time  to  evaluate  the  “real  world”  performance  of 
models  under  non-ideal  conditions.  Results  have  been  presented 
for  computation  of  global  radiation  [11]  and  diffuse  radiation  [12]. 

The  objectives  of  this  investigation  are  twofold.  First,  a  review 
of  models  performance  is  made,  by  comparing  their  predictions 
under  identical  climate  conditions  and  using  a  unique  testing  pro¬ 
cedure  for  computation  of  global  and  diffuse  radiation.  Second,  the 
sensitivity  of  each  model’s  performance  on  the  accuracy  in  the 
atmospheric  databases  used  as  inputs  is  reported  for  both  types 
of  solar  radiation. 

2.  Models 

All  the  54  models  for  computation  of  global  and  diffuse  irradi- 
ance  on  horizontal  surface  are  briefly  described  in  what  follows, 
using  a  call  number  (G001  to  G054)  for  further  reference.  Some  of 
these  models  were  already  tested  in  [9,10,13].  Fortran  routines  for 
all  models  may  be  found  in  [11,12].  The  only  input  variable  that  is 
common  to  all  models  is  the  zenith  angle,  Z,  which  characterizes 
the  sun  position.  For  those  models  that  refer  to  the  solar  constant, 
a  common  value  of  1366.1  W/m2  is  used  [14]. 

G001.  ASHRAE  1972 

This  is  a  historical  model  still  widely  used  by  engineers  to  cal¬ 
culate  solar  heat  gains  and  cooling  loads  in  buildings,  or  insolation 
of  simple  solar  systems.  It  is  based  on  original  empirical  work  con¬ 
ducted  in  the  1950s  and  1960s  [15].  For  more  details,  see  [3,10]. 

G002.  ASHRAE  2005 

ASHRAE  2005  is  similar  to  ASHRAE  model  of  1 972,  but  with  some 
revised  coefficients  that  appeared  in  [16]. 

G003.  Badescu 

This  model  is  based  on  MAC  (entry  G029  in  this  list),  and  was 
proposed  by  Badescu  [17]. 

G004.  Bashahu 

The  composite  model  of  Bashahu  and  Laplaze  [18]  is  based  on 
the  direct  irradiance  model  of  King  and  Buckius  [19];  see  entry  G027 
below. 

G005.  BCLSM 

This  is  the  model  originally  proposed  by  Barbaro  et  al.  [20]  and 
later  modified  in  [1,4,21].  The  original  Barbaro  equations  are  used 
here,  with  three  modifications:  (1)  The  units  in  Barbaro’s  Eq.  (10) 
are  converted  from  cal/(cm2  min)  to  W/m2,  using  1  cal  =  4.184J;  (2) 
a  multiplier  of  0.1  that  was  apparently  missing  in  the  second  part 
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of  Eq.  (10)  has  been  added;  and  (3)  Barbara's  Eq.  (11)  has  been 
corrected  for  the  missing  cos  Z  term  involving  the  zenith  angle  Z. 

G006.  Biga 

This  is  the  model  proposed  by  Biga  and  Rosa  [22]. 

G007.  Bird  model 

This  is  the  broadband  transmittances  and  turbidity  model 
according  to  Bird  and  Hulstrom  [23,24].  For  more  details,  see 
[10,25]. 

G008.  CEM 

This  is  the  broadband  model  proposed  in  Atwater  and  Ball 
[26,27].  See  details  in  [25]. 

G009.  Chandra 

In  this  model  proposed  by  Chandra  [28],  the  Linke  turbidity 
coefficient,  TL,  was  originally  a  necessary  input.  This  coefficient  is 
obtained  here  from  an  average  of  four  linear  relationships  between 
Angstrom’s  coefficient  and  TL,  as  proposed  in  [29-32]: 

Tl  =  2.1331  +  19.0204^.  (1) 

Tl  must  be  constrained  to  the  range  2-5  to  avoid  divergence 
in  Chandra’s  model.  Chandra  reported  his  results  as  abso¬ 
lute  irradiances  in  cal/(cm2  min),  and  used  a  solar  constant  of 
1.94cal/(cm2  min)  or  1353  W/m2.  His  results  are  therefore  divided 
here  by  1 .94  to  obtain  transmittances.  This  empirical  model  is  based 
on  measurements  that  certainly  used  the  IPS56  radiometric  scale, 
hence  the  multiplication  by  a  correction  factor  of  1 .022  [33  ]  to  com¬ 
ply  with  the  current  WRR  scale  (whose  announcement  by  the  World 
Meteorological  Organization  in  1978  is  posterior  to  the  historical 
data  used  for  the  model’s  development). 

G010.  CLS 

This  is  the  Cloud  Layer  Sunshine  model  developed  by  Suckling 
and  Hay  [34,35].  Note  that  precipitable  water  must  be  in  cm,  con- 
trarily  to  what  is  indicated  in  the  original  papers. 

G011.CPCR2 

This  is  the  original  CPCR2  model  by  Gueymard  [36]  with  revised 
optical  masses  [3]. 

G012.  Dogniaux 

This  combines  the  models  that  have  been  proposed  by  Dogniaux 
for  direct  radiation  [37]  and  for  diffuse  radiation  [38].  The  expres¬ 
sion  for  Tl  as  a  function  of  ^  is  taken  here  from  [39].  See  [25]  for 
details. 

G013.DPP 

This  is  the  Daneshyar-Paltridge-Proctor  model  tested  in  [4,40] 
and  also  reviewed  in  [41  ].  The  DPP  acronym  is  from  Badescu  [4].  The 
direct  irradiance  at  normal  incidence  is  here  from  the  original  paper 
by  Daneshyar  [42]  who  used  the  model  of  Paltridge  and  Proctor 
[43],  with  corrected  unit  for  Z.  (It  is  actually  degrees  rather  than 
radians  as  Badescu  or  Daneshyar  suggested.)  Coefficients  for  diffuse 
irradiance  are  given  by  Daneshyar  as  0.218  and  0.299  cal/(cm2  h) 
for  the  USA,  as  cited  from  [44].  Daneshyar  also  suggests  0.123  and 
0.181  for  Iran.  However,  their  Eq.  (5a)  suggests  that  Z  is  in  radians, 
which  is  not  correct.  Goswami  and  Klett  [40]  used  the  USA  values, 
which  are  used  here  too,  after  conversion  from  cal/(cm2  h)  to  W/m2 . 
They  used  the  correct  unit  for  Z.  Festa  and  Ratto  [41  ]  mention  the 
Iran  values,  but  with  Z  in  radians  rather  than  degrees,  due  to  the 
confusion  in  the  original  papers.  Badescu  [4]  also  used  radians,  but 
with  considerably  larger  values  for  the  coefficients.  To  avoid  further 
confusion,  the  modified  equations  as  used  here  are  provided  below: 

Ebn  =  950[1  -  exp(-0. 075/i)]  (2) 

Ed  =  2.534  +  3.475/1  (3) 

Here  Ebn  and  Ed  stand  for  direct  normal  irradiance  and  diffuse  irradi¬ 
ance,  respectively,  both  measured  in  W/m2.  The  sun  altitude  angle 
is  given  by  h  =  90  -  Z  where  Z  is  in  degrees. 

G014.  ESRA1 


This  is  the  model  that  was  used  to  develop  the  European  Solar 
Radiation  Atlas,  with  the  broadband  transmittances  and  turbidity 
computed  according  to  Rigollier  et  al.  [45,46].  Here  the  Linke  tur¬ 
bidity  coefficient  for  an  air  mass  of  2  is  obtained  from  the  new 
Page’s  formula,  Eq.  (19)  of  [47].  This  revision  was  suggested  in  [48]. 
For  more  details,  see  [10]. 

G015.  ESRA2 

This  model  is  the  same  as  ESRA1,  except  that  TL  is  now  obtained 
using  formulae  proposed  in  [7,49]. 

G016.  ESRA3 

This  model  is  similar  to  ESRA1  or  ESRA2,  but  TL  is  obtained  from 
the  empirical  formula  of  [50]  as  a  function  of  precipitable  water 
and  Angstrom’s  ^  coefficient. 

G017.  ESRA4 

This  model  is  again  similar  to  ESRA1,  but  TL  is  obtained  here 
from  Eq.  (1). 

G018.  HLJ 

This  is  the  broadband  model  developed  by  Hottel  [51  ]  for  direct 
irradiance,  and  later  modified  in  [52-56],  who  all  added  the  diffuse 
transmittance  formula  of  Liu  and  Jordan  [57],  based  on  Hottel’s  own 
recommendation.  The  Hottel  equations  corresponding  to  a  visibil¬ 
ity  of  23  km  are  used  here,  which  is  consistent  with  the  literature 
cited.  For  more  details,  see  [10]. 

G019.  Ideriah 

This  model  is  proposed  in  Ideriah  [58]  based  on  the  direct  irra¬ 
diance  model  by  King  and  Buckius  (see  entry  G027  below). 

G020.  Ineichen 

This  model  comes  from  Ineichen’s  parameterization  of  the  SOLIS 
spectral  model  [59].  For  more  details,  see  [10]. 

G021.  Iqbal  A 

This  is  “model  A”  from  Iqbal  [33].  It  is  adapted  from  the  McMas- 
ter  (MAC)  model  [60].  The  original  formulation  for  the  Rayleigh 
transmittance  is  used  here,  rather  than  Iqbal’s  Eq.  (7.4.8),  which 
contains  a  typo.  For  more  details,  see  Gueymard  [3,10]. 

G022.  Iqbal  B 

This  is  “model  B”  from  Iqbal  [33].  It  is  adapted  from  the  Hoyt 
model  [61  ].  For  more  details,  see  [3,10]. 

G023.  Iqbal  C 

This  is  “model  C”  from  Iqbal  [33].  It  is  adapted  from  Bird’s  model 
(entry  G005  above).  For  more  details,  see  [3,10,25]. 

G024.  Josefsson 

This  is  the  model  by  Josefsson  [62],  as  described,  used  and/or 
modified  in  [1,2].  See  [3]  for  details. 

G025.  KASM 

This  is  the  modified  Kasten  model  [63]  according  to  [4]. 

G026.  Kasten 

This  is  another  modification  of  the  original  Kasten  model  [63], 
this  time  following  [2,64].  TL  is  obtained  from  Eq.  (1). 

G027.  King 

This  model  uses  the  broadband  transmittances  and  turbidity 
functions  according  to  King  and  Buckius  [19]  and  Buckius  and  King 
[65  ].  The  former  reference  provides  and  expression  that  can  be  used 
to  calculate  direct  irradiance  [25].  In  the  latter  reference,  the  diffuse 
irradiance  is  to  be  calculated  from  its  Eq.  (36),  but  two  free  param¬ 
eters  remain,  namely  kl  and  a\ .  For  this  investigation,  the  function 
kl  has  been  fitted  to  the  numerical  values  provided  in  [65]  for  five 
discrete  values  of  y 3 ,  such  as 

kl  =  0.8336  +  0.17257j6  -  0.64595  exp(-7.4296JS1'5)  (4) 

Similarly,  the  value  of  coefficient  a\  was  only  described  as  vary¬ 
ing  between  0  and  1.  The  average  value  =0.5  is  assumed  here  in 
the  absence  of  more  specific  indications. 

G028.  KZHW 

This  model  was  proposed  by  Krarti  et  al.  [64]  as  a  combina¬ 
tion  of  those  of  Zhang  and  Huang  [66]  for  global  radiation  and 
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Watanabe  et  al.  [67]  for  the  direct/diffuse  component  separation. 
The  empirical  coefficients  as  modified  in  [64]  are  used  here. 

G029.  MAC 

The  McMaster  model  of  Davies  et  al.  [60]  was  later  used 
and/or  modified  in  [1,2,68].  The  formulation  (particularly  for  the 
Rayleigh  and  aerosol  transmittances)  used  here  is  as  described  in 
[1].  A  corrected  Rayleigh  transmittance  expression  is  used  here 
since  it  was  misprinted  in  the  latter  report.  For  more  details,  see 
[3,10]. 

G030.  Machler 

This  is  the  model  proposed  by  Machler  and  Iqbal  [69]. 

G031.  METSTAT 

This  is  a  modified  version  of  Bird’s  model  (entry  G007  above) 
according  to  Maxwell  [70].  For  more  details,  and  how  to  evaluate 
the  Unsworth-Monteith  turbidity  coefficient  it  uses,  see  [3,10,25]. 

G032.  MRM4 

This  model  is  described  by  Muneer  et  al.  [71]  and  Kambezidis 
[72].  The  numerical  coefficients  considered  here  are  for  the  USA 
and  southern  Europe,  as  given  in  [73,  p.  73].  For  more  details,  and 
a  discussion  of  this  model’s  shortcomings,  see  [25,74]. 

G033.  MRM5 

More  than  a  mere  revision  of  MRM4  (entry  G032  just  above), 
this  is  actually  a  completely  different  algorithm.  It  is  adapted  here 
from  Fortran  code,  version  5,  by  Kambezidis  and  Psiloglou  [75,76]. 
Ozone,  precipitable  water,  Angstrom’s  coefficient  ^  and  albedo  are 
the  input  variables  here,  as  discussed  in  [10]. 

G034.  Nijegorodov 

This  model  [77]  uses  the  air  mass  formula  from  Nijegorodov 
and  Luhanga  [78]  and  transmittance  expressions  from  Bird’s  model 
(entry  G007  above).  It  is  assumed  here  that  the  Earth  radius  is 
6367  km  and  that  the  effective  atmosphere  thickness  is  29.7  km. 

G035.  NRCC 

The  original  model  by  Belcher  and  DeGaetano  [79,80]  was 
slightly  modified  according  to  personal  communications  with 
Belcher  [81],  as  discussed  in  [10]. 

G036.  Paltridge 

This  is  the  empirical  model  of  Paltridge  and  Platt  [82]. 

G037.  Perrin 

This  is  the  broadband  model  of  Perrin  de  Brichambaut  and  Vauge 
[83],  as  discussed  in  [25]. 

G038.  PR 

A  part  of  this  model  is  described  in  Psiloglou  et  al.  [84].  However, 
the  aerosol  transmittance  expression  is  here  from  the  REST  model 
[25]  per  Psiloglou’s  request  [85],  with  the  purpose  to  improve 
the  model’s  performance.  The  new  acronym  stands  for  “Psiloglou- 
REST”. 

G039.  PSIM 

This  model  is  described  by  Gueymard  [74]  and  its  performance 
for  direct  irradiance  predictions  was  discussed  in  [25,74]. 

G040.  REST250 

This  is  version  5.0  of  the  REST2  model,  as  described  by  Gueymard 

[86]. 

G041.  Rodgers 

This  model  uses  the  Unsworth-Monteith  turbidity  coefficient. 
It  is  described  by  Rodgers  et  al.  [87].  See  also  [25]. 

G042.  RSC 

Carroll  [88]  combined  earlier  algorithms  by  Robinson  [89]  and 
Sellers  [90]  to  derive  this  model,  hence  its  acronym. 

G043.  Santamouris 

This  model  is  based  on  atmospheric  transmittances  from 
Psiloglou  et  al.  [84]  (entry  G029  above),  following  the  advice  of  Dr. 
Santamouris  [91].  A  pressure  correction  was  added  where  needed 
for  consistency,  as  also  discussed  in  [25]. 

G044.  Schulze 

This  model  was  proposed  by  Schulze  [92]. 

G045.  Sharma 


This  empirical  model  was  proposed  by  Sharma  and  Pal  [93  ].  They 
used  a  solar  constant  of  2  cal/(cm2  min),  which  is  replaced  here  by 
the  more  recent  value  of  1366.1  W/m2  [14]. 

G046.  Watt 

This  model  was  proposed  by  Watt  [94],  and  its  performance 
was  studied  by  Bird  and  Hulstrom  [24].  These  authors,  however, 
seem  to  have  misinterpreted  some  equations,  due  to  Watt’s  non¬ 
explicit  use  of  the  decimal  logarithm.  This  can  explain  the  subpar 
performance  results  of  the  Bird  and  Hulstrom  study.  The  required 
extinction  layer  heights  are  derived  here  from  the  original  author’s 
Fig.  4.0.2.  A  fixed  stratospheric  turbidity  of  0.02  is  assumed. 

G047.  Wesely 

This  model  by  Wesely  and  Lipschutz  [95,96]  uses  visibility, 
which  is  derived  here  from  Angstrom’s  coefficient  by  using  the 
formula  of  [19]  in  reverse  mode. 

G048.  Yang 

The  original  model  of  Yang  et  al.  [97]  is  used  here  with  the  cor¬ 
rections  described  in  [25],  which  were  eventually  included  in  a  later 
description  of  the  model  [98]. 

G049.  Zhang 

The  model  proposed  by  Zhang  et  al.  [66,99]  described 
site-specific  coefficients  empirically  derived  from  radiation  mea¬ 
surements  in  China.  For  this  study,  the  average  of  the  coefficients 
tabulated  for  24  sites  [99]  was  rather  used  for  improved  universal¬ 
ity.  The  model’s  Gompertz  function  that  separates  the  direct  and 
diffuse  components  appeared  to  generate  unphysical  values,  which 
was  caused  by  its  coefficient  a4  being  misprinted.  The  correct  value 
(2.99)  is  used  here  [100]. 

G050.  HS 

This  is  a  combination  between  the  model  by  Haurwith  [  1 01 ,1 02] 
to  predict  direct  irradiance  and  the  model  by  Schulze  [92]  to  predict 
diffuse  irradiance. 

G051.  ABCGS 

This  is  a  combination  between  the  model  by 
Adnot-Bourges-Campana-Gicquel  [103]  to  predict  direct 
irradiance  and  the  model  by  Schulze  [92]  to  predict  diffuse 
irradiance. 

G052.  Paulescu  and  Schlett 

In  this  model  by  Paulescu  and  Schlett  [104],  the  value  y  =  0.5  is 
adopted  here  to  approximate  a  Rayleigh  atmosphere,  based  on  the 
suggestion  by  Paulescu  [105]. 

G053.  Janjai 

This  model  is  based  on  publications  by  Janjai  [106]  and  Janjai 
and  Sricharoen  [107]. 

G054.  REST281 

This  is  version  8.1  of  REST2  model,  which  contains  a  few 
corrections  compared  to  the  entry  G040  above  and  the  original 
description  by  Gueymard  [86].  For  more  details  on  this  model  see 
Gueymard  [10]. 

3.  Input  data 

The  input  data  depends  on  model.  Table  1  shows  the  input 
parameters  needed  by  all  models  while  Table  2  shows  the  entries 
needed  by  each  model.  The  input  data  have  been  organized  in  sev¬ 
eral  databases  as  described  next. 

3.1.  Solar  radiation  measurements 

The  solar  radiation  database  consists  of  global  and  diffuse 
hourly  irradiation  measured  by  using  Kipp  &  Zonen  radiometers 
in  Cluj-Napoca  and  Bucharest-Afumati  (see  Table  3  for  geo¬ 
graphic  coordinates).  A  Kipp  &  Zonen  CM11  device  is  operating 
at  Bucharest-Afumati  station  while  the  Cluj-Napoca  station  is  pro¬ 
vided  with  CM6B  devices.  The  measurement  uncertainty  is  ±3%  for 
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Table  1 

Input  data  for  models  used  in  this  work. 


Symbol 

Meaning 

Astronomical 

Year 

Number  of  year 

Month 

Number  of  the  month  in  the  year  (1  to  12) 

Day 

Number  of  day  in  the  month  (1  to  31 ) 

h 

Hour (UTC) 

5 

Sun  declination  (deg.) 

z 

Zenith  angle  (deg.) 

Esc 

Solar  constant  (W/m2) 

EnO 

Extraterrestrial  irradiance  (W/m2),  corrected  for  the  actual 

mK 

sun-earth  distance 

Kasten’s  air  mass 

m  ky 

Kasten  &  Young’s  air  mass 

Geographical 

X 

Latitude  (deg) 

9 

Longitude  (deg) 

hg 

Site’s  elevation  (meter) 

Pg 

Ground  albedo 

Meteorological  (surface) 

P 

Surface  air  pressure  (hPa) 

T 

Air  temperature,  dry-bulb  (K) 

AT 

dry-bulb  temperature  T  at  time  t,  T(t),  -T(t-  3  h) 

U 

Surface  air  relative  humidity  (%) 

W 

Wind  speed  (m/s) 

Meterological  (column  integrated) 

U0 

Reduced  ozone  vertical  pathlength  (atm-cm) 

Un 

Total  NO2  vertical  pathlength  (atm-cm) 

w 

Precipitable  water  (cm) 

Quantities  related  to  atmospheric  turbidity 

a 

Angstrom  wavelength  exponent 

P 

Angstrom  turbidity 

OL\ 

Angstrom  wavelength  exponent  for  <700  nm 

a2 

Angstrom  wavelength  exponent  for  >700  nm 

T&\ 

Aerosol  single-scattering  albedo,  <700  nm 

r&2 

Aerosol  single-scattering  albedo,  >700  nm 

Tl  i 

Linke  turbidity  estimated  by  using  Page/Remund  method 

Tl2 

[47] 

Linke  turbidity  estimated  by  using  Ineichen  method  [7] 

Tl3 

Linke  turbidity  estimated  from  the  empirical  formula  of 

E la 

Dogniaux  [50]  as  a  function  of  precipitable  water  and 
Angstrom’s  beta  coefficient 

Linke  turbidity  estimated  from  the  average  of  four  linear 

Ta 

relationships  between  Angstrom’s  beta  coefficient  and 

Linke  turbidity  by  Hinzpeter  [29],  Katz  et  al.  [30], 
Abdelrahman  et  al.  [31  ]  and  Grenier  et  al.  [32]. 
Unsworth-Monteith  broadband  turbidity  coefficient 

T700 

Aerosol  optical  depth  at  700  nm,  dimensionless 

vis 

Visibility  (km) 

CM11  and  ±5%  for  CM6B.  The  temperature  dependence  of  sensi¬ 
tivity  is  ±1%  for  CM11  and  ±2%  for  CM6B,  on  the  interval  -20  to 
+40  °C.  On  a  monthly  basis  the  bias  for  CM6B  ranges  between  -2% 
and  +0.9%  [108].  The  radiometers  are  checked  twice  per  week  and 
cleaned  when  necessary. 

The  measurement  methodology  is  provided  by  standard 
procedures  prepared  at  the  Romanian  National  Meteorological 
Administration.  Measurements  are  performed  as  follows.  Solar  irra- 
diance  (units:  W/m2)  is  measured  at  1-min  intervals.  The  series  of 
irradiance  values  are  averaged  over  10  min,  60  min  and  1440  min, 
respectively.  Irradiation  values  (units:  J)  for  1 0  min,  1  h  and  24  h  are 
obtained  by  multiplying  the  appropriate  average  irradiance  values 
by  the  appropriate  time  duration.  The  integration  interval  starts  Vi 
hour  before  the  time  stamp  in  the  files  and  ends  Vi  hour  after  that 
time  stamp.  Central  European  Time  is  used  in  the  files. 

The  radiometers  are  calibrated  once  per  year  through 
shaded-unshaded  measurements  in  clear  sky  days  and  through 
direct  irradiance  measurements  on  a  horizontal  surface  with  refer¬ 
ence  to  the  Linke-Feussner  etalon  actinometer.  The  Linke-Feussner 
etalon  is  calibrated  with  reference  to  the  national  etalon,  i.e. 
an  Angstrom  702  pirheliometer  with  electric  compensation.  The 


national  etalon  is  calibrated  once  at  five  years  with  reference  to  the 
World  Radiometric  Reference  at  Davos  (Swiss). 

Partial  sky  obstructions  or  shading  of  the  sensors  by  natural  or 
artificial  structures  is  low  and  is  not  considered.  There  are  less  than 
0.1%  missing  or  suspicious  data. 

3.2.  Surface  meteorological  data 

Meteorological  data  measured  in  all  stations  of  Table  3  are  used 
in  this  study.  A  few  details  follow.  In  case  of  Bucharest,  some  of  the 
meteorological  variables  are  measured  at  Bucharest-Baneasa  sta¬ 
tion,  whereas  other  parameters  are  measured  at  Bucharest-Afumati 
station.  Sunshine  duration  is  calculated  from  solar  radiation  by 
using  the  World  Meteorological  Organization  sunshine  criterion 
[109].  This  stipulates  that  the  “sun  is  shining”  if  the  global  solar  irra¬ 
diance  measured  perpendicular  on  sun’s  rays  exceeds  120  W/m2. 
Sunshine  data  are  recorded  hourly.  Daily  totals  are  also  computed. 
Measurements  are  reported  in  tens  of  an  hour. 

3.3.  Column  integrated  data 

3.3. 1.  Ozone 

Long-term  measurements  of  column-integrated  ozone  are 
performed  in  Romania  once  per  day  at  a  single  station  (Bucharest- 
Baneasa).  Measurements  are  performed  usually  in  the  interval 
0900-1400  (Eastern  European  Time).  There  are  missing  days  in  the 
recordings  (Saturdays,  Sundays  as  well  as  other  days).  The  WOUDC 
archive  provides  data  for  Bucharest  during  1980-2006.  Ozone  data 
measured  in  2009  are  used  here  (see  Fig.  SI  of  [1 1  ]). 

3.3.2.  Precipitable  water 

Data  for  column-integrated  precipitable  water  are  available 
from  two  stations.  Radiosonde  measurements  are  performed  twice 
daily  at  Bucharest-Baneasa  (0000  and  1200  UTC)  and  once  daily 
at  Cluj-Napoca  (0000  UTC).  Daily  measurements  for  precipitable 
water  performed  during  2009  at  Cluj-Napoca  and  Bucharest- 
Baneasa  (see  Figs.  S2  and  S3  in  [11]). 

3.4.  Satellite  derived  data 
3.4A.  Surface  albedo 

The  ground  albedo  is  obtained  for  all  stations  from  satellite 
images  on  a  monthly  basis  and  15-km  spatial  resolution.  We  have 
used  the  Surface  Albedo  (SAL)  product  of  the  Satellite  Applications 
Facility  on  Climate  Monitoring  (CM-SAF)  (http://www.cmsaf.eu), 
which  is  part  of  the  EUMETSAT  distributed  ground  segment.  The 
product  line  covers  broadband  albedo  products  from  the  SEVIRI 
instrument  aboard  Meteosat-9  [110].  No  information  about  topog¬ 
raphy  or  terrain  roughness  around  the  weather  stations  was 
included  in  the  input  data  files  at  this  stage.  Figs.  S4  and  S5  of  [11] 
show  monthly  albedo  information  for  Cluj-Napoca  and  Bucharest- 
Baneasa,  respectively,  as  observed  during  2009. 

3.4.2.  Atmospheric  turbidity  data 

For  each  station  under  scrutiny,  the  Angstrom  turbidity  coeffi¬ 
cients  a  and  /3,  as  well  as  the  aerosol  single-scattering  albedo  zu ,  are 
obtained  from  world  datasets  [111].  These  are  climatological  (long¬ 
term  monthly  average)  values,  whereas  daily  values  would  ideally 
be  necessary.  These  datasets  actually  provide  the  aerosol  optical 
depth  at  550  nm,  ra550,  rather  than  /3.  The  latter  must  therefore  be 
calculated  from  Angstrom’s  Law: 

P  =  ta550  ■  0.55“  (5) 

Data  files  containing  values  of  a,  ra55o  and  m  are  the  primary 
databases  that  are  used  here  to  evaluate  aerosol  extinction  in  those 
models  that  take  it  into  account.  Data  is  gridded  at  1  x  1 0  resolution, 
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Table  2 

Input  data  for  tested  models. 


Model  number 

Model  name 

z 

m 

Pg 

p 

T 

u 

w 

vis 

w 

Uo 

un 

a 

p 

Ta 

Tl 

TJJ 

G001 

ASHRAE72 

X 

G002 

ASHRAE05 

X 

G003 

Badescu 

X 

X 

X 

X 

X 

G004 

Bashasu 

X 

X 

X 

X 

X 

G005 

BCLSM 

X 

X 

X 

G006 

Biga 

X 

G007 

Bird 

X 

X 

X 

X 

X 

X 

X 

X 

G008 

CEM 

X 

X 

X 

X 

X 

G009 

Chandra 

X 

X 

G010 

CLS 

X 

X 

X 

X 

X 

G01 1 

CPCR2 

X 

X 

X 

X 

X 

X 

X 

X 

G012 

Dognio 

X 

X 

X 

X 

G013 

DPPLT 

X 

G014 

ESRA1 

X 

X 

X 

X 

G015 

ESRA2 

X 

X 

X 

X 

G016 

ESRA3 

X 

X 

X 

X 

G017 

ESRA4 

X 

X 

X 

X 

G018 

HLJ 

X 

G019 

Ideria 

X 

X 

X 

X 

X 

X 

G020 

Ineich 

X 

X 

X 

X 

G021 

IqbalA 

X 

X 

X 

X 

X 

X 

X 

X 

X 

G022 

IqbalB 

X 

X 

X 

X 

X 

X 

X 

X 

G023 

IqbalC 

X 

X 

X 

X 

X 

X 

X 

X 

X 

G024 

Josefs 

X 

X 

X 

X 

X 

G025 

KASM 

X 

X 

X 

X 

G026 

Kasten 

X 

X 

X 

X 

G027 

King 

X 

X 

X 

X 

X 

X 

G028 

KZHW 

X 

X 

X 

X 

G029 

MAC 

X 

X 

X 

X 

X 

G030 

Machler 

X 

X 

X 

X 

G031 

METSTAT 

X 

X 

X 

X 

X 

X 

X 

G032 

MRM4 

X 

X 

X 

X 

X 

G033 

MRM5 

X 

X 

X 

X 

X 

X 

X 

G034 

Nijego 

X 

X 

X 

X 

X 

X 

X 

X 

G035 

NRCC 

X 

X 

X 

X 

X 

G036 

Paltri 

X 

G037 

Perrin 

X 

X 

X 

X 

X 

X 

G038 

PR 

X 

X 

X 

X 

X 

X 

X 

G039 

PSIM 

X 

X 

X 

X 

X 

G040 

REST250 

X 

X 

X 

X 

X 

X 

X 

X 

X 

G041 

Rodger 

X 

X 

X 

X 

G042 

RSC 

X 

X 

X 

X 

X 

X 

G043 

Santa 

X 

X 

X 

X 

X 

X 

G044 

Schulz 

X 

G045 

Sharma 

X 

G046 

Watt 

X 

X 

X 

X 

X 

X 

X 

X 

G047 

WKB 

X 

X 

X 

X 

G048 

Yang 

X 

X 

X 

X 

X 

X 

G049 

Zhang 

X 

X 

X 

G050 

HS 

X 

G051 

ABCGS 

X 

G052 

Paulescu 

X 

X 

X 

X 

X 

X 

G053 

Janjai 

X 

X 

X 

X 

X 

X 

X 

G054 

REST281 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Table  3 

Meteorological  stations  involved  in  this  study. 


Geographic  Code 

Station 

Latitude  (deg  N) 

Longitude  (deg  E) 

Altitude  (m) 

430613 

Bucharest-Afumati 

44.50 

26.21 

90 

430608 

Bucharest-Baneasa 

44.50 

26.13 

90 

647334 

Cluj-Napoca 

46.78 

23.57 

417 

and  no  correction  for  elevation  is  considered.  Ideally,  a  much  finer 
spatial  resolution  (such  as  10  km  x  10  km)  would  be  necessary  for 
validation  purposes,  but  this  is  currently  not  available.  Figs.  S4  and 
S5  in  [  1 1  ]  show  the  monthly  values  of  a,  1550  and  zu  at  Cluj-Napoca 
and  Bucharest-Baneasa,  respectively.  Since  no  information  about 
the  inputs  a^,a2,  and  rrr2  in  models  G040  and  G054  is  available, 
the  following  approximations  are  used: 


a\  =  ol2  =  ot 


7JJ\  =  UJ2  =  TJJ 


The  monthly  data  were  smoothed  to  derive  daily  data. 


3.5.  Default  values 

The  column-integrated  nitrogen  dioxide  content  is  not  mea¬ 
sured.  Constant  values  of  0.0002  atm  cm  over  rural  areas  and 
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0.0005  atm  cm  over  cities  are  assumed.  The  latter  value  is  adopted 
here  for  both  Bucharest  and  Cluj-Napoca. 


4.  Testing  procedure 

4.2.  Compatibility  between  various  input  datasets 

Since  the  input  datasets  come  from  various  sources,  it  is  impor¬ 
tant  to  check  their  compatibility. 


4.2.2.  Spatial  compatibility  of  measurement  datasets  at  Bucharest 
Bucharest  has  three  main  meteorological  stations,  two  of  them 
being  of  importance  here:  Bucharest-Baneasa  and  Bucharest- 
Afumati.  Most  meteorological  data  used  as  input  for  testing  the 
models  at  Bucharest  are  measured  at  Bucharest-Baneasa.  How¬ 
ever,  the  sunshine  data  come  from  Bucharest-Afumati.  The  two 
stations  are  10.8  km  away  (see  Fig.  S6  of  [11]).  Although  the  rel¬ 
ative  sunshine  might  be  different  at  the  two  stations,  the  testing 
procedure  used  here  refers  to  clear  days  only.  It  is  likely  that  the 
sky  will  be  clear  simultaneously  at  both  stations,  considering  the 
short  distance  and  homogeneous  terrain.  The  same  should  be  true 
for  the  meteorological  variables  measured  at  one  station  and  used 
to  model  solar  radiation  at  the  other.  Therefore  it  is  anticipated  that 
the  distance  issue  will  not  significantly  affect  the  results. 


4.2.2.  Time  compatibility  between  measurements  datasets 

Most  meteorological  datasets  are  prepared  with  reference  to 
UTC.  Solar  radiation  datasets  and  relative  sunshine  are  reported  by 
using  Central  European  Time.  Time  compatibility  has  been  ensured 
between  different  datasets.  We  used  different  procedures  to  obtain 
time  integrations  of  various  quantities  (such  as  relative  sunshine 
and  solar  irradiation).  A  preprocessing  of  the  data  was  therefore 
needed  before  it  could  be  used  for  this  study.  The  quantities  were 
grouped  according  to  their  measurement  time  stamp  and  two  or 
more  files  with  input  data  were  prepared  for  the  same  station; 
each  file  contains  those  measured  quantities  associated  to  the  same 
measurement  time. 


4.2.3.  Compatibility  between  datasets 

Disagreement  may  exist  between  the  two  quantities  related  to 
the  state  of  the  sky:  cloud  cover  amount  C  and  relative  sunshine  a 
(both  quantities  range  between  0  and  1).  Indeed,  the  cloud  cover 
amount  is  an  instantaneous  quantity  while  the  relative  sunshine 
results  by  time  integration.  The  sky  might  be  clear  at  the  estima¬ 
tion  moment  (hence  C=0)  while  during  the  integration  interval 
the  sun  may  be  covered  by  clouds  from  time  to  time,  resulting  a 
o<  1  relative  sunshine  value.  However,  at  Bucharest  the  disagree¬ 
ment  between  C  and  a  may  be  larger  than  usual  because  these  two 
quantities  are  measured  in  two  different  locations. 


4.2.  Computation  of  various  quantities 
42 A.  Astronomical  quantities 

Irradiance  is  a  strong  function  of  the  solar  zenith  angle,  Z.  Most 
models  take  the  solar  geometry  into  account  through  the  relative 
air  mass,  m,  rather  than  Z.  The  specific  relationship  between  m  and  Z 
recommended  by  each  model  is  used  here.  Computations  were  per¬ 
formed  only  forZ<  85°  to  avoid  inaccuracies  resulting  from  possible 
horizon  shading  or  experimental  cosine  errors,  for  instance. 


4.2.2.  Atmospheric  turbidity  parameters 

A  more  elaborate  value  of  the  Angstrom  turbidity  coefficient  (3 
is  used  in  computation.  A  first  estimate  of  the  Angstrom  turbidity 


(say  P)  is  computed  by  using  Eq.  (5).  Next,  the  modal  value  ft  is 
calculated  from 

*  £(0.83212  +  3.2104/)) 

P= - x -  (8) 

1  +5.852£0-75 

Some  models  use  a  special  value  of  ft  that  corresponds  to  an  a 
value  fixed  at  1.3.  It  is  calculated  here  by  using  Eq.  (5)  with  a  = 

1 .3.  These  various  inputs  used  by  different  models  to  evaluate  the 
effects  of  aerosols  are  shown  in  Table  2.  No  elevation  correction  is 
needed  since  all  locations  are  low  altitude. 

The  parameter  /32  for  models  G040  and  G054  corresponds  to  a 
determined  from  spectral  measurements  of  aerosol  optical  depth 
(AOD)  for  wavelengths  between  700  and  lOOOnm.  Since  no  infor¬ 
mation  about  p2  is  available,  the  following  approximation  is  used: 

h  =  P  O) 

A  simplified  way  of  characterizing  the  optical  depth  of  aerosols 
is  through  a  broadband  turbidity  index.  Well-known  examples  of 
such  are  the  Linke  turbidity  factor,  TL,  and  the  broadband  aerosol 
optical  depth  (BAOD),  rfl,  also  known  as  the  Unsworth-Monteith 
coefficient.  These  indicators  are  input  for  some  models  as  shown  in 
Table  2. 


4.3.  Accuracy  indicators 


One  considers  n  couples  of  measured  and  computed  values, 
denoted  n+  and  q  (i  =  l,n),  respectively.  The  mean  values  of  these 
measured  and  computed  values  are  defined  as: 


(10) 


(11) 


For  the  ith  couple,  the  difference  between  the  predicted  and  the 
measured  value  is: 


e;  =  Cj-rrii  (12) 

Note  that  this  difference  q  has  the  same  physical  dimension  as 
rrij  and  q.  This  difference  would  be  an  error  if  could  be  considered 
the  truth,  which  is  obviously  not  the  case,  since  all  measurements 
have  their  own  uncertainty. 

The  most  common  bulk  performance  statistics  are  the  Mean 
Bias  Error  ( MBE )  and  the  Root  Mean  Square  Error  ( RMSE )  which 
are  defined  as 

n 

MBE  =  -L'V  e:  (13) 

nmz 

1=1 


RMSE  =  i 
m 


\ 


(14) 


Eqs.  (13)  and  (14)  provide  dimensionless  quantities  since  their 
right  hand  side  has  been  divided  by  the  mean  measured  irradiance 
or  irradiation.  In  what  follows,  they  are  expressed  in  percent  for 
clarity. 


4.4.  Broad  criteria  for  model  performance 


A  model  designed  to  compute  hourly  solar  irradiation  provides 
good  performance  if  the  MBE  and  RMSE  have  as  low  values  as  pos¬ 
sible.  The  following  quantitative  recommendations  are  sometimes 
used  [9].  For  global  irradiation,  MBE  within  ±10%  and  RMSE  <20% 
indicate  good  fitting  between  model  results  and  measurements. 
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For  diffuse  irradiation,  a  good  fitting  means  MBE  within  ±20%  and 
RMSE<30%. 

Here  more  stringent  criteria  for  model  performance  are  adopted. 
A  model  to  compute  solar  global  hourly  irradiation  provides  “good 
performance”  if: 

•  the  model  is  well  calibrated  (i.e.  -5%  <  MBE  <  +5%)  and 

•  the  scatter  in  the  results  is  such  that  RMSE<  15%. 

A  model  to  compute  solar  diffuse  hourly  irradiation  provides 
“good  performance”  if: 

•  it  is  well  calibrated  (i.e.  - 1 0%  <  MBE  <+10%  and 

•  the  scatter  in  the  results  is  such  that  RMSE  <  30%). 

5.  Results  and  discussion 

In  the  following  we  denote  by  a  the  hourly  relative  sunshine 
(between  0  and  1 )  and  by  C  the  total  cloud  cover  amount  (between 
0  and  1  -  instantaneous  quantity). 

The  testing  procedure  is  performed  in  several  stages  intended  to 
provide  information  about  the  sensitivity  of  the  models  to  various 
sets  of  input  data.  Separate  analyses  are  performed  for  Cluj-Napoca 
and  Bucharest.  In  both  cases,  details  are  first  provided  about  the 
available  input  data  while  the  results  are  reported  next.  Finally,  an 
overall  conclusion  about  models’  performance  is  drawn. 

5.2.  Ana  lysis  fo  r  Cluj -Nap  o  ca 

A  first  test  (so  called  Stage  1)  consisted  of  checking  the  proce¬ 
dure.  A  large  number  of  subsequent  tests  have  been  performed  for 
Cluj-Napoca  by  using  data  from  2009.  The  most  relevant  steps  are 
reported  here. 

5.2.2.  Input  data 
Stage  2 

This  testing  stage  is  associated  to  the  best  available  input  data. 
Only  data  associated  to  C=0  and  a  =  1  were  used.  A  total  of  133 
hourly  recordings  were  used  in  calculations. 

Daily  measurements  for  precipitable  water  performed  once  per 
day  at  0.00  UTC  at  Cluj-Napoca  were  used.  Daily  measurements 
for  ozone  performed  once  per  day  at  12.00  UTC  at  Bucharest  were 
used  for  Cluj-Napoca.  For  intermediate  hours,  precipitable  water 
and  ozone  values  were  linearly  interpolated  between  two  consec¬ 
utive  measured  values.  Satellite  data  were  used  to  derive  monthly 
averaged  values  for  albedo,  a ,  1550  and  zu  for  Cluj-Napoca.  Each 
value  derived  from  satellite  data  was  associated  to  the  15th  day  in 
a  month.  For  intermediate  days,  values  were  linearly  interpolated. 
A  constant  value  is  assumed  during  the  day. 

Stage  3 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  visual  (direct)  estimation  of  the  state  of  the 
sky.  Therefore,  only  data  associated  to  C = 0  were  used  while  the  val¬ 
ues  of  a  are  free  to  vary.  A  few  data  points  associated  to  C=0  and 
cr  =  0  exist.  They  may  occur  in  clear  days  near  the  sunrise  and  sun¬ 
set,  when  the  global  radiation  is  small  and  the  WMO  “sun  shining” 
criterion  may  not  work.  Other  input  data  are  similar  to  those  for 
Stage  2.  A  total  of  166  hourly  recordings  were  used  in  calculations. 
Stage  4 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  (indirect)  estimation  of  the  state  of  the  sky 
(i.e.  by  means  of  sunshine  recordings).  Indeed,  the  approximation 
C=  1  -  a  is  sometimes  used  in  literature  when  data  on  cloud  cover 
amount  is  missing.  Only  data  associated  to  a  =  1  were  used  while 
the  values  of  C  are  free  to  vary.  Many  of  the  cloud  cover  values 


equal  0,  as  expected.  However,  positive  values  of  C  are  also  present. 
Such  sort  of  situations  may  be  imagined.  Indeed,  the  sun  may  shine 
continuously  for  1  h  despite  some  parts  of  the  sky  being  covered 
by  clouds.  Other  input  data  are  similar  to  those  used  for  Stage  2.  A 
total  of  775  hourly  recordings  were  used  in  calculations. 

Stage  5 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  ozone  content  in  the  atmosphere.  A  constant 
value  u0  =  0.3  atm  cm  was  assumed  all  over  the  year.  Other  input 
data  are  similar  to  those  of  Stage  2.  A  total  of  133  hourly  recordings 
were  used  in  calculations. 

Stage  6 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  precipitable  water.  The  precipitable  water 
content  has  been  computed  by  using  Leckner  formula  [112].  Other 
input  data  are  similar  to  those  used  for  Stage  2.  A  total  of  1 33  hourly 
recordings  were  used  in  calculations. 

Stage  7 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  ground  albedo.  A  constant  value  0.2  has  been 
used  for  the  ground  albedo  all  over  the  year.  Other  input  data  are 
similar  to  those  used  for  Stage  2.  A  total  of  133  hourly  recordings 
were  used  in  calculations. 

Stage  8 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  visual  estimation  of  the  state  of  the  sky  and 
ozone.  Only  data  for  C= 0  were  used  (i.e.  the  values  of  the  sunshine 
fraction  are  free  to  vary).  Other  input  data  are  similar  to  those  used 
for  Stage  5  (where  a  constant  ozone  value  has  been  used  as  input). 
A  total  of  166  hourly  recordings  were  used  in  calculations. 

Stage  9 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  visual  estimation  of  the  state  of  the  sky  and 
precipitable  water.  Only  data  for  C=0  were  used  (i.e.  the  values  of 
the  sunshine  fraction  are  free  to  vary).  Other  input  data  are  similar 
to  those  used  for  Stage  6  (where  the  precipitable  water  has  been 
computed  by  using  Leckner’s  formula  [112]).  A  total  of  166  hourly 
recordings  were  used  in  calculations. 

Stage  10 

This  testing  stage  estimates  models  performance  sensitivity  to 
input  data  related  to  visual  estimation  of  the  state  of  the  sky  and 
ground  albedo.  Only  data  for  C=0  were  used  (i.e.  the  values  of  the 
sunshine  fraction  are  free  to  vary).  Other  input  data  are  similar  to 
those  used  for  Stage  7  (when  a  fixed  value  of  ground  albedo  has  been 
used).  A  total  of  166  hourly  recordings  were  used  in  calculations. 

Stage  1 1 

This  testing  stage  estimates  models  performance  sensitivity 
when  measurements  about  ozone,  precipitable  water  and  ground 
albedo  are  missing  but  surface  measurement  data  are  available.  A 
constant  ozone  amount  0.3  atm  cm  has  been  assumed.  Precipitable 
water  has  been  computed  by  using  Leckner  formula  [112].  A  con¬ 
stant  ground  albedo  value  (0.2)  has  been  assumed.  Other  input  data 
are  similar  to  those  used  for  Stage  2.  A  total  of  1 33  hourly  recordings 
were  used  in  calculations. 

Stage  12 

This  testing  stage  estimates  models  performance  sensitivity 
when  measurements  about  ozone,  precipitable  water  and  ground 
albedo  are  missing  and  only  visual  information  about  the  state  of 
the  sky  exists.  Only  data  for  C=0  were  used  (i.e.  the  values  of  the 
sunshine  fraction  are  free  to  vary).  Other  input  data  are  similar  to 
those  used  for  Stage  1 1 .  A  total  of  1 66  hourly  recordings  were  used 
in  calculations. 

Stage  13 

This  testing  stage  is  associated  to  the  best  available  input  data 
during  the  extended  warm  season  (April-October).  Only  data  asso¬ 
ciated  to  C=  0  and  a  =  1  were  used.  Other  input  data  are  similar  to 
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those  used  for  Stage  2.  A  total  of  129  hourly  recordings  were  used 
in  calculations. 

Stage  14 

This  testing  stage  is  associated  to  the  best  available  input  data 
during  the  extended  cold  season  (November-March).  Only  data 
associated  to  C = 0  and  a  =  1  were  used.  Other  input  data  are  similar 
to  those  used  for  Stage  2.  A  total  of  4  hourly  recordings  were  used. 
Therefore,  the  results  associated  to  this  Stage  should  be  taken  with 
caution  due  to  the  small  number  of  recordings. 

Stage  1 5 

This  testing  stage  estimates  models  performance  sensitivity 
during  the  extended  warm  season  (April-October)  to  input  data 
related  to  visual  estimation  of  the  state  of  the  sky.  Therefore,  only 
data  associated  to  C=0  were  used  while  the  values  of  a  are  free  to 
vary.  Other  input  data  are  similar  to  those  used  for  Stage  3.  A  total 
of  161  hourly  recordings  were  used. 

Stage  1 6 

This  testing  stage  estimates  models  performance  sensitivity 
during  the  extended  cold  season  (November-March)  to  input  data 
related  to  visual  estimation  of  the  state  of  the  sky.  Therefore,  only 
data  associated  to  C=0  were  used  while  the  values  of  a  are  free  to 
vary.  Other  input  data  are  similar  to  those  used  for  Stage  3.  A  total 
of  5  hourly  recordings  were  used. 

Stage  1 7 

This  testing  stage  estimates  models  performance  sensitivity 
during  the  extended  warm  season  (April-October)  to  input  data 
related  to  indirect  estimation  of  the  state  of  the  sky.  Only  data 
associated  to  a  =  1  were  used  in  this  stage  while  the  values 
of  C  are  free  to  vary.  Other  input  data  are  similar  to  those 
used  for  Stage  4.  A  total  of  695  hourly  recordings  were  used  in 
calculations. 

Stage  1 8 

This  testing  stage  estimates  models  performance  sensitivity 
during  the  extended  cold  season  (November-March)  to  input 
data  related  to  indirect  estimation  of  the  state  of  the  sky.  Only 
data  associated  to  a  =  1  were  used  in  this  stage  while  the  val¬ 
ues  of  C  are  free  to  vary.  Other  input  data  are  similar  to  those 
used  for  Stage  4.  A  total  of  65  hourly  recordings  were  used  in 
calculations. 

Stage  19 

This  testing  stage  estimates  models  performance  sensitivity 
when  measurements  about  ozone,  precipitable  water  and  ground 
albedo  are  missing  but  surface  measurement  data  are  available  for 
the  extended  warm  season  (April-October).  Other  input  data  are 
similar  to  those  used  for  Stage  1 1.  A  total  of  129  hourly  recordings 
were  used  in  calculations. 

Stage  20 

This  testing  stage  estimates  models  performance  sensitivity 
when  measurements  about  ozone,  precipitable  water  and  ground 
albedo  are  missing  but  surface  measurement  data  are  available  dur¬ 
ing  the  extended  cold  season  (November-March).  Other  input  data 
are  similar  to  those  used  for  Stage  1 1 .  A  total  of  4  hourly  recordings 
were  used  in  calculations. 

Stage  21 

This  testing  stage  estimates  models  performance  sensitivity 
during  the  extended  warm  season  (April-October)  when  mea¬ 
surements  about  ozone,  precipitable  water  and  ground  albedo  are 
missing  but  visual  information  about  the  state  of  the  sky  is  avail¬ 
able.  Only  data  for  C=0  were  used  (i.e.  the  values  of  the  sunshine 
fraction  are  free  to  vary).  Other  input  data  are  similar  to  those 
used  for  Stage  12.  A  total  of  161  hourly  recordings  were  used  in 
calculations. 

Stage  22 

This  testing  stage  estimates  models  performance  sensitivity 
during  the  extended  cold  season  (November-March)  when  mea¬ 
surements  about  ozone,  precipitable  water  and  ground  albedo  are 


missing  but  visual  information  about  the  state  of  the  sky  is  avail¬ 
able.  Only  data  for  C=0  were  used  (i.e.  the  values  of  the  sunshine 
fraction  are  free  to  vary).  Other  input  data  are  similar  to  those 
used  for  Stage  12.  A  total  of  5  hourly  recordings  were  used  in 
calculations. 


5.2.2.  Results 

Table  4  shows  the  models  accuracy  for  computing  global  radia¬ 
tion  at  Cluj-Napoca.  MBE  is  used  as  the  main  accuracy  indicator.  No 
model  passed  the  testing  stages  4, 17  and  18.  This  is  not  surprising 
since  the  catalogue  contains  clear  sky  models  only  and  such  sort  of 
models  has  no  input  parameter  associated  to  the  state  of  the  sky. 
Despite  the  filter  a  =  1  is  imposed,  the  testing  stages  4,  17  and  18 
allow  input  data  from  days  with  cloudy  sky  (i.e.  C  ^  0).  Indeed,  the 
sun  may  shine  without  intermittency  for  a  whole  hour,  with  some 
parts  of  the  sky  being  covered  by  clouds. 

Very  simple  clear  sky  models  are  defined  as  models  which  do 
not  require  meteorological  data  as  input.  Their  input  consists  just  of 
astronomic  data.  These  models  are  G001,  G002,  G006,  G013,  G018, 
GC36,  GC44,  G045,  G050,  and  G051  (see  Table  2).  Table  4  shows  that 
very  simple  models  as  well  as  more  complex  models  may  belong 
to  the  category  of  “good  models”.  This  is  in  agreement  with  pre¬ 
vious  knowledge  about  the  performance  of  clear  sky  models  to 
computing  global  irradiation  [3,9,10]. 

Table  5  shows  models  stratification  according  to  their  accuracy 
for  computing  global  radiation  at  Cluj-Napoca.  The  best  models 
listed  there  fulfill  the  performance  criteria  for  both  MBE  and  RMSE. 
However,  MBE  is  used  for  ranking  the  models.  No  very  simple  model 
is  ranked  among  the  first  three  best  models  in  the  stage  testing.  A 
single  partial  exception  exists:  model  G006  is  the  second  best  in 
Stage  18.  But  the  RMSE  criterion  is  not  fulfilled  for  this  Stage  18,  as 
already  pointed  out. 

Most  of  the  worst  performing  models  have  rather  complex  input 
data  sets  (GC47,  GC19,  GC30,  G005,  G028,  G010,  G049).  Only  two 
very  simple  models  are  ranked  among  the  worst  three  models  per 
stage  (G013  and  G050). 

Fig.  1  shows  the  number  of  testing  stages  per  model  with  accu¬ 
racy  criteria  fulfilled  for  both  MBE  and  RMSE  indicators.  This  way 
of  classification  stratified  the  models  in  several  groups  and  the  first 
eleven  best  groups  are  shown  in  Fig.  1.  Nine  models  belong  to  the 
first  three  best  groups.  One  of  these  models  (i.e.  G001)  is  a  very 
simple  model. 

Table  6  shows  the  models  accuracy  for  computing  diffuse  radi¬ 
ation  at  Cluj-Napoca.  Again,  MBE  is  used  as  the  main  accuracy 
indicator.  No  model  passed  the  testing  stages  4,  17  and  18.  This 
mimics  the  case  of  computing  global  radiation  (Table  4).  How¬ 
ever,  the  number  of  “good”  models  is  smaller  in  case  of  computing 
diffuse  radiation  than  global  radiation  (compare  Tables  6  and  4, 
respectively).  Indeed,  only  fourteen  models  gave  good  performance 
when  computing  diffuse  radiation.  Model  G029  performs  the  best 
for  most  testing  stages. 

Table  7  shows  models  stratification  according  to  their  accuracy 
for  computing  diffuse  radiation  at  Cluj-Napoca.  The  best  models 
listed  there  fulfill  the  performance  criteria  for  both  MBE  and  RMSE 
but  MBE  is  used  to  rank  the  models.  No  single  very  simple  model  is 
ranked  the  first  in  the  stage  testing.  Among  the  very  simple  models, 
G006  is  ranked  in  the  first  three  best  for  several  testing  stages.  Also, 
G002  is  ranked  the  third  best  for  two  testing  stages.  All  the  worst 
performing  models  have  rather  complex  input  data  sets. 

Fig.  2  shows  the  number  of  testing  stages  per  model  with  accu¬ 
racy  criteria  fulfilled  for  both  MBE  and  RMSE  indicators.  This  way 
of  classification  stratified  the  models  in  several  groups  and  the  first 
nine  best  groups  are  shown  in  Fig.  2.  Twelve  models  belong  to  the 
first  three  best  groups.  Three  of  these  models  (i.e.  G001,  G002  and 
G006)  are  very  simple  models. 
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Table  4 

Models’  accuracy  for  computing  solar  global  radiation  at  Cluj-Napoca. 


Color 


Meaning 


Good  models  (criteria  for  both  MBE  and  RMSE  are  fulfilled) 


Best  model  according  to  MBE  criterion;  RMSE  criterion  is  fulfilled 


Best  model  according  to  MBE  criterion;  RMSE  criterion  is  not  fulfilled 


Worst  models  according  to  MBE  criterion 


Stages 

Model 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

G001 

G002 

GO  03 

G004 

G005 

G006 

G007 

G008 

G009 

G010 

G011 

G012 

G013 

G014 

G015 

G016 

G017 

G018 

G019 

G020 

G021 

G022 

G023 

G024 

G025 

G026 

G027 

G028 

G029 

G030 

G031 

G032 

G033 

G034 

G035 

G036 

G037 

G038 

G039 

G040 

G041 

G042 

G043 

G044 

G045 

G046 

G047 

G048 

G049 

G050 

G051 

G052 

GO  53 

G054 

1645 
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Table  5 

Models  ranking  according  to  their  accuracy  to  compute  global  solar  radiation  at  Cluj-Napoca.  The  best  models  fulfill  the  performance  criteria  for  both  MBE  and  RMSE  except 
for  models  whose  number  is  underlined,  which  do  not  fulfill  the  RMSE  criterion. 


Stage 

Ranking  -  best  models 

Ranking  -  worst  models 

1st 

2nd 

3rd 

52nd 

53rd 

54th 

2 

53 

52 

35 

13 

47 

19 

3 

32 

53 

3 

5 

47 

19 

4 

28 

49 

43 

50 

13 

19 

5 

52 

35 

53 

13 

47 

19 

6 

53 

52 

35 

13 

47 

19 

7 

53 

52 

35 

13 

47 

19 

8 

32 

45 

52 

5 

47 

19 

9 

32 

53 

3 

5 

47 

19 

10 

32 

53 

3 

5 

47 

19 

11 

52 

53 

35 

13 

47 

19 

12 

32 

3 

53 

5 

47 

19 

13 

53 

52 

35 

13 

47 

19 

14 

14 

15 

54 

30 

19 

47 

15 

53 

32 

52 

5 

47 

19 

16 

12 

40 

41 

28 

49 

47 

17 

28 

49 

43 

50 

13 

19 

18 

42 

6 

35 

10 

19 

47 

19 

52 

53 

35 

13 

47 

19 

20 

14 

15 

24 

49 

30 

47 

21 

32 

53 

3 

5 

47 

19 

22 

11 

41 

12 

28 

49 

47 

5.2.  Analysis  for  Bucharest 

A  large  number  of  test  stages  have  been  performed  for  Bucharest 
by  using  2009  data.  The  most  relevant  stages  are  reported  here. 

5.2.2.  Input  data 
Stage  32 

This  testing  stage  is  similar  in  most  aspects  to  Stage  2.  The  dif¬ 
ferences  are  as  follows.  The  precipitable  water  has  been  measured 
at  Bucharest-Baneasa  at  0.00  and  12.00  UTC.  Daily  measurements 
for  ozone  were  performed  at  Bucharest  at  1 2.00  UTC.  Monthly  aver¬ 
aged  values  for  albedo,  a ,  r55o  and  zu  for  Bucharest  have  been  used. 
A  total  of  324  hourly  recordings  were  used  during  the  analysis. 
Stage  33 

This  testing  stage  is  similar  in  most  aspects  to  Stage  3.  Only  data 
associated  to  C = 0  were  used  while  the  values  of  a  are  free  to  vary. 


Other  input  data  are  similar  to  the  input  data  used  for  Stage  32.  A 
total  of  391  hourly  recordings  were  used  in  analysis. 

Stage  34 

This  testing  stage  is  similar  in  most  aspects  to  Stage  4.  Only  data 
associated  to  a  =  1  were  used  in  this  stage  while  the  values  of  C  are 
free  to  vary.  Other  input  data  are  similar  to  the  input  data  used  for 
Stage  32.  A  total  of 908  hourly  recordings  were  used  in  computation. 

Stage  35 

This  testing  stage  is  similar  in  most  aspects  to  Stage  5.  A  constant 
value  u0  =  0.3  atm  cm  was  assumed  all  over  the  year.  Other  input 
data  are  similar  to  the  input  data  used  for  Stage  32.  A  total  of  324 
hourly  recordings  were  used  in  computation. 

Stage  36 

This  testing  stage  is  similar  in  most  aspects  to  Stage  6.  The 
precipitable  water  content  has  been  computed  by  using  Leck- 
ner  formula  [112].  Other  input  data  are  similar  to  the  input  data 
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Index  ranking  the  accuracy  groups  of  models 


Fig.  1.  Number  of  testing  stages  per  model  with  accuracy  criteria  fulfilled  for  both  MBE  and  RMSE  indicators.  The  index  ranking  the  accuracy  groups  of  models  is  shown  in 
ordinate.  Global  solar  radiation  at  Cluj-Napoca  is  considered.  The  maximum  number  of  testing  stages  is  twenty-one. 
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Table  6 

Models’  accuracy  for  computing  solar  diffuse  radiation  at  Cluj-Napoca. 
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Color 

Meaning 

Good  models  (criteria  for  both  MBE  and  RMSE  are  fulfilled) 

Best  model  according  to  MBE  criterion;  RMSE  criterion  is  fulfilled 

Best  model  according  to  MBE  criterion;  RMSE  criterion  is  not  fulfilled 

Worst  models  according  to  MBE  criterion 


Stages 


model 
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used  for  Stage  32.  A  total  of  324  hourly  recordings  were  used  in 
computation. 

Stage  37 

This  testing  stage  is  similar  in  most  aspects  to  Stage  7.  A  con¬ 
stant  value  0.2  this  has  been  used  for  the  ground  albedo  all  over 
the  year.  Other  input  data  are  similar  to  the  input  data  used  for 


Stage  32.  A  total  of  324  hourly  recordings  were  used  in  computa¬ 
tion. 

Stage  38 

This  testing  stage  is  similar  in  most  aspects  to  Stage  8.  Only  data 
for  C=0  were  used  (i.e.  the  values  of  the  sunshine  fraction  are  free 
to  vary).  Other  input  data  are  similar  to  the  input  data  used  for  Stage 
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Table  7 

Models  ranking  according  to  their  accuracy  to  compute  diffuse  solar  radiation  at  Cluj-Napoca.  The  best  models  fulfill  the  performance  criteria  for  both  MBE  and  RMSE  except 
for  models  whose  number  is  underlined,  which  do  not  fulfill  the  RMSE  criterion. 


Stage 

Ranking  -  best  models 

Ranking  -  worst  models 

1st 

2nd 

3rd 

52nd 

53rd 

54th 
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35  (i.e.  with  a  constant  ozone  value  as  input).  A  total  of  391  hourly 
recordings  were  used  in  computation. 

Stage  39 

This  testing  stage  is  similar  in  most  aspects  to  Stage  9.  Only  data 
for  C= 0  were  used  (i.e.  the  values  of  the  sunshine  fraction  are  free  to 
vary).  Other  input  data  are  similar  to  the  input  data  used  for  Stage  36 
(i.e.  with  precipitable  water  computed  by  using  Leckner’s  formula 
[112]).  A  total  of  391  hourly  recordings  were  used  in  computation. 

Stage  40 

This  testing  stage  is  similar  in  most  aspects  to  Stage  10.  Only 
data  for  C=0  were  used  (i.e.  the  values  of  the  sunshine  fraction  are 
free  to  vary).  Other  input  data  are  similar  to  the  input  data  used 
for  Stage  37  (i.e.  with  fixed  value  of  ground  albedo).  A  total  of  391 
hourly  recordings  were  used  in  computation. 


Stage  41 

This  testing  stage  is  similar  in  most  aspects  to  Stage  11. 
A  constant  ozone  amount  0.3  atm  cm  has  been  assumed.  Pre¬ 
cipitable  water  has  been  computed  by  using  Leckner  formula 
[112].  A  constant  ground  albedo  value  (0.2)  has  been  assumed. 
Other  input  data  are  similar  to  the  input  data  used  for  Stage 
32.  A  total  of  324  hourly  recordings  were  used  in  computa¬ 
tion. 

Stage  42 

This  testing  stage  is  similar  in  most  aspects  to  Stage  12.  Only 
data  for  C=0  were  used  (i.e.  the  values  of  the  sunshine  fraction 
are  free  to  vary).  Other  input  data  are  similar  to  the  input  data 
used  for  Stage  41.  A  total  of  391  hourly  recordings  were  used  in 
computation. 
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Fig.  2.  Same  as  Fig.  1,  for  diffuse  solar  radiation  at  Cluj-Napoca. 
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Table  8 

Models  accuracy  for  computing  solar  global  radiation  at  Bucharest. 
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Color 

Meaning 

Good  models  (criteria  for  both  MBE  and  RMSE  are  fulfilled) 

Best  model  at  that  Stage  according  to  MBE  criterion;  RMSE  criterion  is  fulfilled 

Best  model  at  that  Stage  according  to  MBE  criterion;  RMSE  criterion  is  not  fulfilled 

Worst  models  at  that  Stage  according  to  MBE  criterion 


Stages 
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Stage  43 

This  testing  stage  is  similar  in  most  aspects  to  Stage  13.  Only 
data  associated  to  C=0  and  a  =  1  were  used.  Other  input  data  are 
similar  to  the  input  data  used  for  Stage  32.  A  total  of  289  hourly 
recordings  were  used  in  computation. 

Stage  44 

This  testing  stage  is  similar  in  most  aspects  to  Stage  14.  Only 
data  associated  to  C=0  and  a  =  1  were  used.  Other  input  data  are 


similar  to  the  input  data  used  for  Stage  32.  A  total  of  35  hourly 
recordings  were  used  in  computation. 

Stage  45 

This  testing  stage  is  similar  in  most  aspects  to  Stage  15.  Only 
data  associated  to  C=0  were  used  while  the  values  of  a  are 
free  to  vary.  Other  input  data  are  similar  to  the  input  data  used 
for  Stage  33.  A  total  of  328  hourly  recordings  were  used  in 
computation. 
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Table  9 

Models  ranking  according  to  their  accuracy  to  compute  global  solar  radiation  at  Bucharest.  The  best  models  fulfill  the  performance  criteria  for  both  MBE  and  RMSE  except 
for  models  whose  number  is  underlined,  which  do  not  fulfill  the  RMSE  criterion. 


Stage 

Ranking  -  best  models 

Ranking  -  worst  models 

1st 

2nd 

3rd 

52nd 

53rd 

54th 
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34 
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19 
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Stage  46 

This  testing  stage  is  similar  in  most  aspects  to  Stage  16.  Only 
data  associated  to  C=0  were  used  while  the  values  of  a  are  free  to 
vary.  Other  input  data  are  similar  to  the  input  data  used  for  Stage 
33.  A  total  of  63  hourly  recordings  were  used  in  computation. 

Stage  47 

This  testing  stage  is  similar  in  most  aspects  to  Stage  17.  Only 
data  associated  to  a  =  1  were  used  in  this  stage  while  the  values 
of  C  are  free  to  vary.  Other  input  data  are  similar  to  the  input  data 
used  for  Stage  34.  A  total  of  874  hourly  recordings  were  used  in 
computation. 

Stage  48 

This  testing  stage  is  similar  in  most  aspects  to  Stage  1 8.  Only  data 
associated  to  a  =  1  were  used  in  this  stage  while  the  values  of  C  are 


free  to  vary.  Other  input  data  are  similar  to  the  input  data  used  for 
Stage  34.  A  total  of  95  hourly  recordings  were  used  in  computation. 

Stage  49 

This  testing  stage  is  similar  in  most  aspects  to  Stage  18.  Other 
input  data  are  similar  to  the  input  data  used  for  Stage  41 .  A  total  of 
289  hourly  recordings  were  used  in  computation. 

Stage  50 

This  testing  stage  is  similar  in  most  aspects  to  Stage  19.  Other 
input  data  are  similar  to  the  input  data  used  for  Stage  41 .  A  total  of 
35  hourly  recordings  were  used  in  computation. 

Stage  51 

This  testing  stage  is  similar  in  most  aspects  to  Stage  21.  Only 
data  for  C=0  were  used  (i.e.  the  values  of  the  sunshine  fraction  are 
free  to  vary).  Other  input  data  are  similar  to  the  input  data  used  for 
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Fig.  3.  Same  as  Fig.  1  for  global  solar  radiation  at  Bucharest. 
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Table  10 

Models  accuracy  for  computing  solar  global  radiation  at  Cluj-Napoca  and  Bucharest. 
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Color  Meaning 


Models  obeying  both  criteria  (MBE  and  RMSE)  in  both  localities 


Models  which  are  simultaneously  the  best  in  both  localities 


Models  which  are  simultaneously  the  worst  in  both  localities 


Stages  (Cluj-Napoca/Bucarest) 


Stage  42.  A  total  of  328  hourly  recordings  were  used  in  computa¬ 
tion. 

Stage  52 

This  testing  stage  is  similar  in  most  aspects  to  Stage  22.  Only 
data  for  C= 0  were  used  (i.e.  the  values  of  the  sunshine  fraction  are 
free  to  vary).  Other  input  data  are  similar  to  the  input  data  used  for 
Stage  52.  A  total  of  63  hourly  recordings  were  used  in  computation. 


5.2.2.  Results 

Table  8  shows  the  models  accuracy  for  computing  global  radi¬ 
ation  at  Bucharest.  MBE  is  used  as  the  main  accuracy  indicator. 
There  is  obvious  similarity  with  the  results  obtained  for  Cluj- 
Napoca  (compare  Tables  8  and  4).  First,  no  model  passed  the 
testing  stages  4,  17  and  18.  Second,  very  simple  models  as  well 
as  more  complex  models  may  belong  to  the  category  of  “good 
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Fig.  4.  Same  as  Fig.  1  for  global  solar  radiation  at  Cluj-Napoca  and  Bucharest. 


models”.  Third,  models  G019  and  G047  perform  the  worst  in  both 
cases. 

However,  visual  inspection  shows  that  generally  a  given  model 
performs  better  at  Bucharest  than  at  Cluj-Napoca  (the  number  of 
testing  stages  with  accuracy  criteria  fulfilled  is  generally  larger  at 
Bucharest  than  at  Cluj-Napoca).  Also,  the  category  of  best  models 
per  stage  has  generally  different  members  in  the  two  locations.  Only 
models  G032  and  G053  belong  to  this  category  in  Cluj-Napoca  and 
Bucharest.  The  other  members  are  G011,  G012,  G014  and  G052  at 
Cluj-Napoca  and  G003,  G008,  G016,  G020,  G025,  G031,  G033  and 
G054  at  Bucharest. 

Table  9  shows  models  stratification  according  to  their  accuracy 
for  computing  global  radiation  at  Bucharest.  The  best  models  listed 


there  fulfill  the  performance  criteria  for  both  MBE  and  RMSE  indi¬ 
cators.  However,  MBE  is  used  there  to  rank  the  models. 

The  very  simple  model  G045  is  ranked  the  second  best  in  stage 
44  and  the  third  best  in  several  other  stages.  Also,  the  very  simple 
model  G036  is  ranked  the  third  best  at  stage  46.  This  is  different 
from  Cluj-Napoca  where  no  single  very  simple  model  is  ranked 
among  the  first  three  best  in  the  stage  testing  (see  Table  5).  Sim¬ 
ilarly  to  Cluj-Napoca,  the  worst  performing  models  are  G019  and 
G047.  Among  other  models  ranked  between  positions  52  and  54 
one  finds  models  with  complex  input  dataset  but  also  very  simple 
models  (G050  for  instance). 

Fig.  3  shows  the  number  of  testing  stages  per  model  with  accu¬ 
racy  criteria  fulfilled  for  both  MBE  and  RMSE  indicators.  This  way 
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Fig.  5.  Same  as  Fig.  1  for  global  solar  radiation  (at  Cluj-Napoca  and  Bucharest)  and  diffuse  solar  radiation  (at  Cluj-Napoca). 
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Table  11 

Models  accuracy  for  computing  global  radiation  (at  Cluj-Napoca  and  Bucharest)  and  diffuse  radiation  (at  Cluj-Napoca). 


Color 


Meaning 


Models  obeying  both  criteria  (MBE  and  RMSE)  in  both  localities 


Models  which  are  simultaneously  the  worst  in  both  localities 


Stages  (Cluj-Napoca/Bucarest) 
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of  classification  stratified  the  models  in  several  groups  and  the  first 
thirteen  best  groups  are  shown  in  Fig.  3.  Seventeen  models  belong 
to  the  first  three  best  groups.  This  number  is  larger  than  the  sim¬ 
ilar  number  for  Cluj-Napoca  (compare  Figs.  3  and  1,  respectively). 
Three  of  the  models  belonging  to  the  first  three  best  groups  (i.e. 
G001,  G006  and  G045)  are  very  simple  models.  This  has  to  be  com¬ 
pared  with  the  case  of  Cluj-Napoca,  where  only  one  very  simple 
model  (G001 )  belongs  to  the  first  three  best  groups  (see  Fig.  1 ). 


5.3.  Overall  analysis  for  Cluj-Napoca  and  Bucharest 

An  overview  of  results  obtained  in  both  localities  is  useful. 
Table  1 0  shows  the  models  accuracy  for  computing  global  radiation 
at  Cluj-Napoca  and  Bucharest.  MBE  is  used  as  the  main  accuracy 
indicator. 

First,  no  model  passed  the  testing  stages  4/34, 17/47  and  18/48. 
This  is  a  consequence  of  the  results  shown  in  Tables  4  and  8. 
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Second,  four  very  simple  models  (i.e.  G001,  G006,  G044  and  G045) 
are  good  models  for  some  particular  stages.  Third,  models  G019 
and  G047  perform  the  worst  for  most  stages  in  both  localities.  Just 
two  models  (G032  and  G053)  are  the  best  in  the  two  locations,  for 
similar  testing  stages  (i.e.  Stages  5/35  for  G032  and  2/32  and  7/37 
for  G053). 

Fig.  4  shows  the  number  of  testing  stages  per  model  with  accu¬ 
racy  criteria  fulfilled  for  both  MBE  and  RMSE  indicators.  This  way 
of  classification  stratified  the  models  in  several  groups  and  the  first 
twelve  best  groups  are  shown  in  Fig.  4.  Sixteen  models  belong  to  the 
first  three  best  groups.  This  number  is  between  the  similar  numbers 
for  Cluj-Napoca  (Fig.  1)  and  Bucharest  (Fig.  3),  respectively.  How¬ 
ever,  note  that  the  best  three  groups  in  Figs.  1  and  3  refers  to  1 8, 1 7 
and  16  testing  stages  passed  by  a  given  model,  respectively,  while 
in  Fig.  4  the  best  three  groups  refer  to  16,  15  and  14  testing  stages 
passed  by  a  given  model,  respectively.  Three  models  belonging  to 
the  first  three  best  groups  in  Fig.  4  (i.e.  G001,  G006  and  G045)  are 
very  simple  models. 

Table  1 1  shows  the  models  accuracy  for  computing  global  radi¬ 
ation  (at  Cluj-Napoca  and  Bucharest)  and  diffuse  radiation  (at 
Cluj-Napoca).  MBE  is  used  as  the  main  accuracy  indicator.  First,  no 
model  passed  the  testing  stages  4, 1 7  and  1 8.  This  is  a  consequence 
of  the  results  shown  in  Tables  4  and  8.  Second,  some  very  simple 
models  (i.e.  G001,  G006  and  G045)  are  good  models  for  some  par¬ 
ticular  stages.  Third,  model  G01 9  perform  the  worst  for  most  stages 
in  both  localities. 

There  is  no  single  model  performing  the  best  in  computing  both 
global  and  diffuse  radiation,  in  both  localities,  for  similar  testing 
stages. 

Fig.  5  shows  the  number  of  testing  stages  per  model  with  accu¬ 
racy  criteria  fulfilled  for  both  MBE  and  RMSE  indicators.  This  way 
of  classification  stratified  the  models  in  several  groups  and  the  first 
seven  best  groups  are  shown  in  Fig.  5.  Six  models  belong  to  the  first 
three  best  groups.  Note  that  the  best  three  groups  in  Fig.  5  refers 
to  14,  13  and  10  testing  stages  passed  by  a  given  model,  respec¬ 
tively.  These  are  considerably  low  numbers.  Compare  them  with 
the  best  three  groups  when  computing  global  radiation  in  a  single 
location  (i.e.  18, 17  and  16  testing  stages  passed  by  a  given  model; 
see  Figs.  1  and  3).  Or,  compare  them  with  the  best  three  groups 
when  computing  diffuse  radiation  in  a  single  location  (i.e.  18,  16 
and  14  testing  stages  passed  by  a  given  model;  see  Figs.  2).  Or, 
finally,  compare  them  with  the  best  three  groups  when  computing 
global  radiation  in  two  locations  (i.e.  16,  15  and  14  testing  stages 
passed  by  a  given  model;  see  Fig.  4). 

Three  models  belonging  to  the  first  three  best  groups  in  Fig.  5 
(i.e.  G001,  G006  and  G045)  are  very  simple  models. 


6.  Conclusions 

Fifty-four  broad  band  models  for  computation  of  global  and  dif¬ 
fuse  irradiance  on  horizontal  surface  were  selected.  These  models 
were  tested  by  using  input  data  from  two  meteorological  sta¬ 
tions  from  Romania  (South-Eastern  Europe),  i.e.  Cluj-Napoca  and 
Bucharest.  The  input  data  consist  of  surface  meteorological  data, 
column  integrated  data  and  data  derived  from  satellite  measure¬ 
ments.  The  testing  procedure  is  performed  in  forty-two  stages 
intended  to  provide  information  about  the  sensitivity  of  the  models 
to  various  sets  of  input  data. 

Looking  to  the  results  for  global  radiation  computation  at  Cluj- 
Napoca,  one  sees  that  nine  models  belong  to  the  first  three  best 
groups.  One  of  these  models  (i.e.  G001)  is  a  very  simple  model. 
However,  no  single  very  simple  model  is  ranked  among  the  first 
three  best  models  in  the  stage  testing.  In  case  of  computing  diffuse 
radiation,  the  number  of  “good”  models  is  smaller  than  when  com¬ 
puting  global  radiation.  Also,  no  very  simple  model  is  ranked  the 


first  best  model  in  a  particular  testing  stage.  However,  three  models 
of  the  first  nine  best  groups  (i.e.  G001 ,  G002  and  G006)  are  very  sim¬ 
ple  models.  Model  G029  gives  the  best  results  to  compute  diffuse 
radiation  for  most  testing  stages.  The  best  models  for  solar  diffuse 
radiation  computation  are,  on  equal-footing,  G002  and  G027.  The 
second  best  model  is  G029. 

Looking  to  the  results  for  global  radiation  computation  at 
Bucharest,  the  models  perform  generally  better  than  at  Cluj- 
Napoca.  Indeed,  in  Bucharest  seventeen  models  belong  to  the  first 
three  best  groups.  But  the  category  of  best  models  per  stage  has 
generally  different  members  in  the  two  locations.  Three  of  the  mod¬ 
els  belonging  to  the  first  three  best  groups  in  Bucharest  (i.e.  G001, 
G006  and  G045)  are  very  simple  models. 

Looking  to  the  combined  results  for  global  radiation  computa¬ 
tion  at  Cluj-Napoca  and  Bucharest,  one  sees  that  sixteen  models 
belong  to  the  first  three  best  groups.  Three  models  belonging  to  the 
first  three  best  groups  (i.e.  G001,  G006  and  G045)  are  very  simple 
models.  Only  two  models  (G032  and  G053)  are  the  best  in  both  loca¬ 
tions,  for  one  or  two  testing  stages.  The  best  models  for  solar  global 
radiation  computation  are,  on  equal-footing,  G01 6,  G020,  G03 1  and 
G054.  The  second  best  models  are,  on  equal-footing,  G007,  G008 
and  G052. 

Looking  to  the  combined  results  for  global  and  diffuse  radiation 
computation  at  Cluj-Napoca  and  Bucharest,  the  following  conclu¬ 
sions  can  be  drawn.  There  is  no  single  model  performing  the  best 
in  computing  both  global  and  diffuse  radiation,  in  both  localities, 
for  similar  testing  stages.  Six  models  belong  to  the  first  three  best 
groups.  Three  models  belonging  to  the  first  three  best  groups  in 
Fig.  5  (i.e.  G001,  G006  and  G045)  are  very  simple  models.  The  best 
models  for  computation  of  both  global  and  diffuse  radiation  are,  on 
equal-footing,  G001,  G006,  G020  and  G054.  The  second  best  model 
is  G052. 

We  may  conclude  that  models’  accuracy  depends  on  the  set  of 
input  data.  There  is  no  model  to  be  ranked  “the  best”  for  all  sets  of 
input  data.  Very  simple  models  as  well  as  more  complex  models 
may  belong  to  the  category  of  “good  models”  but  generally  the  last 
models  perform  better. 

Detailed  information  about  the  performance  of  each  model  is 
provided  in  [11,12]. 
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